The Sandwich (robust Covariance Matrix) Estimator
نویسندگان
چکیده
The sandwich estimator, often known as the robust covariance matrix estimator or the empirical covariance matrix estimator, has achieved increasing use with the growing popularity of generalized estimating equations. Its virtue is that it provides consistent estimates of the covariance matrix for parameter estimates even when a parametric model fails to hold, or is not even specified. Surprisingly though, there has been little discussion of the properties of the sandwich method other than consistency. We investigate the sandwich estimator in quasilikelihood models asymptotically, and in the linear case analytically. We show that when the quasilikelihood model is correct, the sandwich covariance matrix estimate is often far more variable than the usual parametric variance estimate, and its coverage probabilities can be abysmal. The increased variance is a fixed feature of the method, and the price one pays to obtain consistency even when the parametric model fails. We make some simple suggestions for modifying the method which improve coverage probabilities.
منابع مشابه
The Sandwich Variance Estimator: EÆciency Properties and Coverage Probability of Con dence Intervals
The sandwich estimator, often known as the robust covariance matrix estimator or the empirical covariance matrix estimator, has achieved increasing use with the growing popularity of generalized estimating equations. Its virtue is that it provides consistent estimates of the covariance matrix for parameter estimates even when the tted parametric model fails to hold, or is not even speci ed. Sur...
متن کاملRobust covariance estimator for small-sample adjustment in the generalized estimating equations: A simulation study
The robust or sandwich estimator is common to estimate the covariance matrix of the estimated regression parameter for generalized estimating equation (GEE) method to analyze longitudinal data. However, the robust estimator would underestimate the variance under a small sample size. We propose an alternative covariance estimator to the robust estimator to improve the small-sample bias in the GE...
متن کاملNo Free Lunch with the Sandwich
In nonlinear regression theory, the sandwich estimator of the covariance matrix of the model parameters is known as a consistent estimator, even when the parameterized model does not contain the regression. However, in the latter case, we emphasize the fact that the consistency of the sandwich holds only if the inputs of the training set are the values of independent identically distributed ran...
متن کاملRisk of Bayesian Inference in Misspecified Models, and the Sandwich Covariance Matrix∗
It is well known that in misspecified parametric models, the maximum likelihood estimator (MLE) is consistent for the pseudo-true value and has an asymptotically normal sampling distribution with "sandwich" covariance matrix. Also, posteriors are asymptotically centered at the MLE, normal and of asymptotic variance that is in general different than the sandwich matrix. It is shown that due to t...
متن کاملRobust M-Estimation for Array Processing: A Random Matrix Approach
This article studies the limiting behavior of a robust M-estimator of population covariance matrices as both the number of available samples and the population size are large. Using tools from random matrix theory, we prove that the difference between the sample covariance matrix and (a scaled version of) the robust M-estimator tends to zero in spectral norm, almost surely. This result is appli...
متن کامل